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CONSTRAINT  QUALIFICATIONS  IN  MAXIMIZATION  PROBLEMS,  II 


Kenneth  J.  Arrow  and  Hlrofuml  Uzawa 


1.  Introduction 

In  the  previous  article  [4],  an  investigation  was  made  of  the 
interrelationship  between  various  conditions  under  which  the  classical 
Lagrange  method  remains  valid  for  maximization  problems  subject  to 
inequality  constraints.  In  the  present  paper,  further  results  on  the 
subject  will  be  discussed  and  simplified  proofs  given.  First,  the 
Kuhn-Tucker  Constraint  Qualification  ([5],  P*  483)  will  be  slightly 
weakened  so  that  the  meaning  of  the  qualification  becomes  more  straight¬ 
forward.  It  will  be  shown  in  Theorem  1  below  that  the  lagrangian  method 
can  be  applied  to  those  constraint  maxima  for  which  the  present  version 
of  the  Constraint  Qualification  is  satisfied.  Then  we  show  that  the 
Constraint  Qualification  in  the  present  formulation  is  the  weakest 
requirement  for  the  Lagrange  method  to  be  applicable;  namely,  in  Theorem  2 
below,  it  is  proved  that  if  the  Lagrange  method  is  Justified  for  any 
differentiable  maxlmand,  then  the  constraint  function  satisfies  the 
Constraint  Qualification  provided  the  constraint  set  is  convex.  Finally, 
in  Section  4  it  will  be  shown  that  the  Constraint  Qualification  is  implied 
by  the  condition  that  the  constraint  functions  corresponding  to  a  certain  set 
of  Indices  are  convex .  The  latter  condition  includes  all  those  given 
earlier  in  [3]  and  [2]. 
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Definitions  and  Preliminary  Remarks. 

Let  g(x)  =  [g^(x),  ...  ,  g™(x)]  te  an  m-vector  valued  function 

defined  for  n-vectors  x  =  (x. ,  ...  ,  x  ).  The  set  of  all  n-vectors  x 

'1  n 

for  which  g(x)  >  0  will  be  called  the  constraint  set  defined  hy  g(x), 
denoted  by  C;  l.e., 

(1)  C  =  {x:g(x)  >  0)  . 

Given  an  n-vector  x  In  C  and  an  arbitrary  n-vector 
I  =  ( •  •  •  }  ijj)>  'the  contained  path  with  origin  x  and  dl  recti  on  | 

Is  defined  as  an  n-vector  valued  function  ij((0)  satisfying: 

(2)  1(0)  is  defined  and  is  continuous  for  all  0  <  0  <  0 

with  some  positive  0; 

(3)  +(0)  =  x;  \lf(e)  €  C  for  all  0  <  0  <  0; 

(4)  +(0)  has  a  right-hand  derivative  at  0=0  such  that 

i'(0)  =  I  . 

An  n-vector  5  for  which  there  Is  a  contained  path  with  origin 
X  and  direction  |  will  be  referred  to  as  an  attalna'ble  direction;  and 
the  set  of  all  attainable  directions  will  be  denoted  by  A.  The  closure 
of  the  convex  cone  spanned  by  A  will  be  denoted  by  K^;  the  elements 
of  will  be  referred  to  as  weakly  attainable  directions. 
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The  set  of  Indices  {1,  . . .  ,  m)  Is  divided  into  two  parts  E 
and  F.  E  Is  the  set  of  all  Indices  effective  indices  at  xj  namely, 

(5)  E  =  =  0)  , 

and  F  is  the  set  of  all  ineffective  indices  at  x;  namely, 

(6)  F  =  {j:g'^(-5c)  >  0)  . 

Let  Kg  be  the  set  of  n-vectors  defined  by 

(7)  Kg  =  (5:g®  I  >  0)  ; 

the  elements  of  Kg  may  be  termed  locally  constrained  directions. 

Lemma  1.  Every  weaJtly  attainable  direction  is  locally 
constrained. 

be  a  contained  path  with  origin  x  and 
J  e  E, 

and  g'^[lr(0)]  >  0  . 


Proof;  Let  '|r(0) 
direction  g.  Then,  for  any 

g'^[  +  (0)]  =  0 

Hence 


I  >  0  . 


Q.E.D. 


A  function  g(x)  will  be  called  to  satisfy  the  (Kuhn -Tucker) 
Constraint  Qualification  at  x  If 

(CQ)  ’ 

i.e.,  every  locally  constrained  direction  is  weakly  attainable.  Kuhn 
and  Tucker  ([5]^  P*  ^83)  required  that  every  locally  constrained  direction 
be  attainable. 

Let  us  define  the  set  K^  by 

(8)  K^  *  the  closure  of  the  set  {\(x-x):\  >  0^  x  €  C)  . 

Lemma  2.  If  the  constraint  set  C  ^  convex,  then 

K3CK1 . 

Proof;  If  X  £  C,  then  by  the  convexity  of  the  set  C, 

X  +  0(x  -  x)  e  C  for  all  0  <  0  <  1  . 

Hence,  x  -  x  is  attainable  and  therefore  weakly  attainable.  Since 
Kj^  is  a  cone,  the  conclusion  follows. 
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hst  B  be  any  set  of  vectors.  The  negative  polar  cone,  to  be 
denoted  by  B”,  Is  defined  by 

B*  «  {u:ux  <  0  for  all  x  e  B)  . 

We  have  (see,  e.g.,  Fenchel  [4],  pp.  8-10), 


(9) 

b" 

Is  a 

closed  convex 

cone; 

(10) 

®1 

CB^ 

Implies  that 

DB-  ; 

(11) 

If 

B  Is 

a  closed  convex 

cone,  B”"  =  B  . 

3.  Lagrange  Regularity  and  the  Constraint  Qualification. 

The  classical  lagrange  method  for  constrained  maxima  (see,  e.g. 
[l],  p.  153)  has  been  adapted  by  Kuhn  and  Tucker  ([5],  Theorem  1,  p.  484). 

(L)  If  X  maximizes  a  differentiable  function  f(x)  subject  to 

X  €  C,  then  there  exists  a  nonnegative  m-vector  y  such  that 

(12)  ^x  ^  ®x  ° 


(13) 


y  g(x)  =  0  . 
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An  m-vector  valued  function  g(x)  will  be  termed  lagrange 
regular  if,  for  any  differentiable  function  f(x),  the  condition  (L)  holds. 

Lemma  3°  If  x  maximizes  f  (x)  sub.lect  to  x  e  C,  then 

where  ^  the  negative  polar  cone  of  K^. 

Proof;  Let  ^r(0)  be  a  contained  path  with  origin  x  and 
direction  g,  then 


f[i(e)]  <  f[+(0)]  =  f(5) 


for  all 


0  <  e  <  5  . 


Then 


fx  6  =  (0)  <  0  ' 


for  any  g  in  A  and,  by  continuity  and  convexity,  for  any  g  e  K^. 


Q.E.D. 


Theorem  1.  If  g(x)  satisfies  the  Constraint  Qualification 
(CQ),  then  g(x)  ^  Lagrange  regular. 
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Proof ;  Let  f(x)  be  a  differentiable  function  and  x 
maximize  f(x)  subject  to  x  e  C-  Then,  by  Lemma  3;  .  On 

the  other  hand,  the  condition  (CQ)  implies,  from  (lO),  that 

k^Ck^ 

Hence,  we  have 

(14)  ^  ^2  • 

By  applying  the  Minkowski -Farkas  Lemma  we  have  from  (7)  and 

(14), 

-  -E  -E  -  -E  ^  _ 

-f^  =  y  for  some  y  >  0  • 


Define 


/-E 

y  =  (y  , 


-F  . 
y  ) 


with 


-F 

y 


=  0. 


Then,  y  satisfies  conditions  (l2)  and  (13).  Q.E.D. 

Theorem  1  is  the  basic  necessity  theorem  for  non-linear 
programming  ([5],  Theorem  l)  extended  to  the  weaker  constraint  qualification 
of  this  paper. 
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Theorem  2.  If  g(x)  ^  lagrange  regular  and  If  the  constraint 
set  C  defined  It  a  convex  set,  then  g(x)  satisfies  the  Constraint 
Qualification  (CQ). 

Proof;  It  will  be  first  shown  that 

(15)  K'CKg  . 

Let  a  €  J  then  for  \  =  1, 

(16)  a(x  -  x)  <  0  for  all 

Then  X  maximizes  the  function  f(x)  =  ax  subject  to 
Lagrange  regularity  of  g(x),  there  Is  an  m-vector  y 

(l?)  a+yg^=0;  y>0, 

and 

(18)  y  g(x)  =  0  . 

The  conditions  (17)  and  (18)  Imply  that 

(19)  a  +  y®  8^  “ 


y®  >  0  . 


X  €  C  . 

X  £  C.  By  the 
such  that 
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The  condition  (19)  implies  that 
a|  <  0  for  all  |  such  that  ^  6  >  0  ; 

namely, 

a  e  Kg  . 

Hence,  we  have  the  relation  (15) • 

Then,  hy  (lO)  and  (ll), 

(20)  K^  D  Kg  . 

Applying  Lemma  2, 

K^  DK^  DKg  .  Q.E.D. 


4.  A  Sufficient  Condition  for  the  Constraint  Qualification. 

Let  E'  he  a  subset  of  the  effective  indices  defined  hy 

(21)  E'  =  (J:J  €  E,  u  g^  =  0,  for  some  u  >  0  with  u  >  O)  . 

X  s  J 

Theorem  3-  If  g'^(x)  convex  for  every  j  €  E',  then  g(x) 
satisfies  the  Constraint  Qualification  (CQ)  at  x. 
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Proof;  By  the  Minkowski -Farkas  Lemma,  an  Index  J  belongs 
to  E'  If  and  only  If 

(22)  <  0  for  all  I  such  that  ^  k  e  E,  k  /  J. 

Hence,  for  any  j  €  E”  =  E  -  E',  there  exists  such  that 

(23)  g'’  >0,  gjj  >  0  for  all  k  e  E,  k  /  J. 

Let 

(24)  I*  =  L  . 

JeE" 

Then,  by  (23)  we  have 
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Since  g'^(x)  is  convex  for  j  e  E',  the  condition  (26)  implies 
that  g'^(x  +  g)  has  its  minimum  in  L  at  |  =  0;  hence, 

(2?)  g^'(x  +  5)  >  0  for  all  I  €  L, 

since  E'  C  E,  so  that  g  (x)  =  0. 

We  shall  now  prove  that  is  contained  in  K^.  Let  J  be 

any  element  of  For  any  positive  a  >  0,  define 

(28)  ilf(0)  =  X  +  (I  +  ag*)  e  . 

From  (27), 

(29)  g*^'[i|r(e)]  >  0  for  all  0  >  0  . 


f 
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F 

Finally,  g  [t|f(0)]  >  O,  so  that 

(31)  g^[+(6)]  >  0  for  0  >  0  and  sufficiently  small. 

The  relations  (29-3l)  Imply  that 

g[+(6)]  >  0  for  6  sufficiently  small  . 

Hence  \|f(0)  is  a  contained  path,  and  6  +  Ct|  is  an  attainable  direction 

* 

for  all  a  >  0.  Therefore,  |  being  a  limit  of  6  +  a|  as  a  tends  to 
zero,  is  weakly  attainable.  Q.E.D. 

Obviously,  the  conclusion  of  Theorem  3  will  hold  if  either 
g'^(x)  is  convex  for  all  J  or  E’  is  the  null  set. 

Corollary  1;  If  g‘^(x)  ^  convex  (in  particular,  linear)  for 

every  J,  then  g(x)  satisfies  the  Constraint  Qualification. 

Corollary  1  extends  Theorem  2  of  [3]. 

Corollary  2:  ([3],  Theorem  3).  Suppose  g(x)  is  concave, 

£1  ^ 

and  g  (x  )  >  0  for  some  x  .  Then  g(x)  satisfies  the  Constraint 


Qualification. 
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Proof:  Since  g  (x)  Ib  concave, 

E>  — E/  *  —  \ 

g  (x  )  -  g  (x)  <  g^(x  -  x)  . 

But  g  (x  )  >  0  and  g  (x)  =  Oj  hence, 

_E,  * 

gx(x  -  x)  >  0  . 


If  ui^ 

-E  *  • 

=  0,  then  ug^(x  -  x)  =0,  which,  for 

u  >  0,  is  only  possible  for 

u  =  0. 

Then  E'  is  null. 

Q.E.D. 

This  condition  was  used  by  Slater  [6] 

for  f(x)  concave. 

Corollary  3:  ([2],  Theorem  2,  n,  18). 

Suppose 

(32) 

g(x)  is  quasi -concave; 

(33) 

g  (x  )  >  0,  for  some  x  ; 

and 

(34) 

for  each  .1  c  E,  either  k'^(x)  concave  or  ^  0. 

Then  the 

Constraint  Qualification  is  satisfied. 

Proof;  If  g'^(x)  is  concave,  for  .1 

e  E,  then  by  (33) 

(35) 

(35) 


Hence,  ty  assumption  (34),  the  relation  (35)  holds  for  all  J  e  E. 

Since  the  set  C  is  convex,  x  -  x  is  attainable  for  all  x  €  C  (see 
Lemma  2).  Since  x  is  an  interior  point  of  C,  x  -  x  Is  an  interior 
point  of  Aj  hence,  the  set  L,  the  space  spanned  by  K^,  is  the  entire 
space. 

If,  for  some  j  e  E, 

=  0  for  all  I  e  . 

Then 

I  =  0  for  all  I  } 

hence 

i^.O, 

contradicting  (35)*  Therefore,  the  set  E'  is  null.  Q.E.D. 

”E 

Corollary  4;  (non-degeneracy).  ^  g^  has  a  rank  equal  to  the 
number  of  effective  con3traln-^s,  then  g(x)  satisfies  the  Constraint 
Qualification. 

Proof ;  By  the  assximptlon  of  the  maximum  rank 

-E 

=  0  Implies  u  =  0  j 


hence,  the  set  E'  is  null. 


Q.E.D. 


Remark:  The  case  of  nonlinear  equality  contraints  Is  not 
handled  by  Theorem  3  or  Corollaries  1-3-  Indeed,  It  could  easily 
happen  in  that  case  there  Is  no  linear  contained  path.  Corollaiy  4 
does  remain  valid  If  some  or  all  constraints  are  eqtialltlesj  see 
[3],  Appendix  1. 
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